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Abstract 

Receptive  fields  in  the  visual  cortex  can  be  altered  by  changing  the  visual  environment,  as  has  been  shown 
many  times  in  deprivation  experiments.  In  this  paper  we  simulate  this  set  of  experiments  using  two  different 
models  of  cortical  plasticity,  BCM  and  PCA.  The  visual  environment  used  is  composed  of  natural  images  for 
open  eye  and  of  noise  for  closed  eyes.  We  measure  the  response  of  the  neurons  to  oriented  stimuli,  and  use  the 
time  course  information  of  the  neuronal  response  to  provide  a  preliminary  quantitative  comparison  between 
the  cortical  models  and  experiment. 


1  Introduction 

Two  important  characteristics  of  the  visual  response  of  most  neurons  in  cat  striate  cortex  aie  that  they  are 
binocular  and  show  a  strong  preference  for  contours  of  a  particular  orientation  (Hubei  and  Wiesel,  1962).  Although 
some  orientation  selectivity  exists  in  striate  cortex  prior  to  visual  experience,  maturation  to  adult  levels  of 
specificity  and  responsiveness  requires  normal  contour  vision  during  the  first  2  months  of  life.  (Albus  and  Wolf, 
1984;  Barlow,  1975;  Blakemore  and  Van-Sluyters,  1975;  Bonds,  1975;  Braastad  and  Heggelund,  1985;  Pregnac 
and  Imbert,  1978;  Fregnac  and  Imbert,  1984;  Movshon  and  van  Sluyters,  1981) 

Ocular  dominance  is  a  measure  of  how  effectively  the  neuron  can  be  driven  through  the  left  and  right 
eyes,  respectively.  Up  to  the  level  of  the  LGN,  visual  information  originating  from  the  two  eyes  is  segregated  in 
separate  pathways,  striate  cortex  is  thus  the  first  site  where  individual  cells  receive  afferent  projections  from  both 
left  and  right  eyes,  and  in  normal  kitten  striate  cortex  most  of  the  visually  responsive  cells  are  binocular. 

One  of  the  most  dramatic  examples  of  cortical  plasticity  is  the  alteration  of  ocular  dominance  in  kitten 
striate  cortex  in  monocular  deprivation,  a  procedure  in  which,  one  eye  is  deprived  of  patterned  stimuli  (by  either 
suturing  the  eyelid  closed  or  using  an  eye  patch).  In  such  an  imbalanced  visual  environment,  cells  in  kitten’s 
striate  cortex  change  from  mostly  binocular  to  almost  exclusively  monocular:  in  less  than  24  hours  most  cells  lose 
their  responsive  to  stimulation  through  the  deprived  eye  and  can  only  be  driven  through  the  eye  that  remains 
open  (Blakemore  and  van  Sluyters,  1974;  Olson  and  Freeman,  1975;  Wiesel  and  Hubei,  1963). 

The  change  induced  by  monocular  deprivation  is  reversible.  In  the  rearing  condition  called  reverse  suture 
there  is  an  initial  period  of  monocular  deprivation:  after  the  cortical  neurons  have  become  monocular,  the  deprived 
eye  is  opened  and  the  other  eye  closed.  In  this  situation  the  cortical  neurons  lose  responsiveness  to  the  newly 
closed  eye,  and  become  responsive  to  the  newly  opened  eye  (Blakemore  and  van  Sluyters,  1974).  Acute  studies 
indicate  that,  as  the  ocular  dominance  of  cortical  responsiveness  shifts  from  one  eye  to  the  other,  there  is  rarely  a 
period  when  cells  can  be  strongly  and  equally  activated  by  both  eyes  (Movshon,  1976;  Mioche  and  Singer,  1989). 

In  this  paper  we  model  this  set  of  experiments,  looking  specifically  at  the  time  course  of  neuronal  response 
during  visual  deprivation.  In  this  way  we  wish  to  directly  compare  two  different  learning  rules  with  each  other, 
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and  also  with  experiment.  The  visual  environment  to  which  open  eyes  are  exposed  is  assumed  to  be  composed  of 
preprocessed  natural  images,  whereas  closed  eyes  receive  noise  as  their  inputs.  The  architecture  assumed  in  these 
models  is  of  single  learning  neurons,  as  a  first  step  to  understanding  the  behavior  of  networks. 

We  compare  the  two  learning  rules  BCM  (Bienenstock  et  al.,  1982;  Intrator  and  Cooper,  1992)  and 
PC  A  (Oja,  1982).  Both  of  these  rules  have  been  shown  to  develop  orientation  selectivity  in  a  realistic  visual 
environment  (Law  and  Cooper,  1994;  Shouval  and  Liu,  1994).  For  binocular  misaligned  inputs  BCM  develops 
cells  with  varying  degrees  of  binocularity  whereas  PCA  develops  only  perfectly  binocular  cells  (Shouval  et  al., 
1996).  Previous  simulations  of  the  deprivation  experiments  have  been  performed  using  simplified  inputs  for  the 
BCM  theory(Clothiaux  et  al.,  1991).  In  this  paper  we  use  realistic  inputs. 


2  Methods 


To  model  the  normal  visual  environment,  we  use  24  gray-scale  images  with  the  dimensions  256  x  256  pixels.  The 
inputs  to  the  retinas  are  processed  with  a  retinal  like  center-surround  receptive  field,  which  we  approximate  as 
a  difference  of  two  Gaussians.  The  receptive  fields  are  restricted  to  finite  circular  patches  of  radius  Hr  =  13. 
Thus  in  each  iteration  a  different  circular  patch  i&  chosen  randomly  as  input  to  the  neuron.  The  exact  time 
course  of  these  simulations  is  dependent  on  the  parameters  chosen;  we  have  therefore  examined  these  over  a  large 
parameter  regime.  At  each  set  of  parameters  we  performed  all  of  the  deprivation  simulations,  and  compared 
their  timing  ratios,  in  order  to  test  the  robustness  of  our  predictions.  Examples  of  the  simulations  are  shown  in 
Figures  1  and  2  for  BCM  and  PCA  respectively. 


Weights  Left 


MD 


RS 


Weights  Right 


Activity  (solid=left,  dashed=right) 


2.0e6  4.0e6 

time  (cycles) 


6.0e6 


Figure  1:  Example  BCM  Simulations.  Left:  Final  weight  configuration.  Right:  Maximum  response 
to  oriented  stimuli,  as  a  function  of  time.  Simulations  from  top  to  bottom  are  as  follows.  Nor¬ 
mal  Rearing  (NR):  both  eyes  presented  with  patterned  input.  Monocular  Deprivation  (MD):  follow¬ 
ing  NR,  one  eye  is  presented  with  noisy  input  and  the  other  with  patterned  input.  Reverse  Su¬ 
ture:  following  MD,  the  eye  given  noisy  input  is  now  given  patterned  input,  and  the  other  eye 
is  given  noisy  input.  Binocular  Deprivation  (BD):  following  NR,  both  eyes  are  given  noisy  input. 
It  is  important  to  note  that  if  Binocular  Deprivation  is  run  longer,  selectivity  will  eventually  be  lost 


We  chose  the  modification  rule  for  the  BCM  simulations  to  be  quadratic,  ih  =  ri<j){c,6)d  =  7]c{c  —  d)d, 
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Weights  Left 


Weights  Right 


Activity  (solid=left,  dashed=right) 


time  (cycles) 


Figure  2:  Example  PC  A  Simulations.  Left:  Final  weight  configuration.  Right:  Maximum  response  to  oriented 
stimuli,  as  a  function  of  time.  Simulations  from  top  to  bottom  are  as  follows.  Normal  Rearing  (NR):  both  eyes 
presented  with  patterned  input.  Monocular  Deprivation  (MD):  following  NR,  one  eye  is  presented  with  noisy 
input  and  the  other  with  patterned  input.  Reverse  Suture:  following  MD,  the  eye  given  noisy  input  is  now  given 
patterned  input,  and  the  other  eye  is  given  noisy  input.  Binocular  Deprivation  (BD):  following  NR,  both  eyes 
are  given  noisy  input. 


where  the  output  is  the  simple  dot  product  of  the  input  and  weight  vectors,  passed  through  a  sigmoid  function, 
c  =  cr(d  *  m).  The  precise  time  course  of  the  neuron  activity  is  dependent  on  the  choice  of  the  functional  form  of 
both  the  modification  function,  </>,  and  the  sigmoid.  Variations  of  these  are  currently  being  investigated. 

We  measure  the  response  Y (t)  of  the  neurons  using  oriented  stimuli.  Of  particular  interest  is  characteristic 
half-rise  (half-fall)  time  for  the  growth  (decay)  of  neuronal  response,  referred  to  as  either  ti/2  or  simply  T.  An 
example  of  this  is  shown  in  Figure  3. 

The  half-time  measurement  provides  a  direct  comparison  between  the  BCM  and  PCA  models.  It  also  pro¬ 
vides  a  way  to  quantitatively  translate  between  simulation  cycles  and  real  time,  yielding  a  quantitative  comparison 
with  experiment. 


3  Results 

Summary  of  Experimental  Results 

The  following  table  summarizes  the  experimental  results  to  which  we  can  compare  the  two  models.  The  exact 
results  depend  on  when  in  the  critical  period  the  experiments  were  done.  The  results  allow  us  to  estimate 
the  values  of  the  activity  half-rise  time,  T^ise,  or  half-fall  time,  Tfaii  whichever  is  appropriate  for  the  particular 
experiment. 
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Monocular  Deprivation 


Monocular  Deprivation 


lO.OeS 


1.5e6 


Figure  3:  Example  of  a  Response  Half-Time  Measurement.  This  is  an  illustration  of  the  procedure  for  measuring 
the  half-times.  Though  the  example  uses  a  BCM  simulation,  the  specific  numbers  are  not  important.  The  time 
is  measured  for  the  neuron  to  either  rise  or  fall,  half  way  between  its  minimum  and  maximum  responses. 


1  Summary  of  Experimental  Results 

Experiment 

Reference 

Half-Time  T 

Monoculeir 

Deprivation 

•  OD  changes  were  observed  as  early  as 

6  h(Freeman  and  Olson,  1982;  Mioche 
and  Singer,  1989) 

•  complete  loss  of  response  to  closed  as 
early  as  12  h(Mioche  and  Singer,  1989) 

•  moderate  increase  of  response  to 
the  normal  eye  occasionally  (Mioche  and 
Singer,  1989) 

«  6-12  h 

Binoculeir 

Deprivation 

•  cortical  response  reduced  within 

3  d(Preeman  et  al.,  1981) 

7^S?<3d 

•  the  time  course  for  the  reduction  of  re¬ 

Reverse 

Suture 

sponse  to  the  newly  deprived  eye  was  sim¬ 
ilar  to  monocular  deprivation(Mioche 
and  Singer,  1989) 

•  At  least  24  h  of  reverse  suture  is 

^RS  ^  'T'MD 
'fall  'fall 

required  before  the  responses  to  the  de¬ 
prived  eye  reappears  (Mioche  and  Singer, 
1989) 

«  1-4  d 

'rise  ^  ^  ^  ^ 

It  will  be  more  useful  to  look  at  ratios  of  these  times,  so  we  can  make  a  reasonable  comparison  with  the 
theory.  The  above  values  of  T  give  us  the  following  ratios,  that  we  can  then  use  in  our  comparison. 

.  0.33<7;|^f/7^S?<16 
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PCA  Results 


We  can  use  the  full  time-domain  solution(Wyatt  and  Elfadel,  1995)  of  the  PCA  equations  in  order  to  explore  the 
deprivation  simulations  analytically.  The  full  detail  of  these  calculations  is  given  in  the  Appendix.  The  solutions 
are  in  terms  of  the  covariance  matrix  of  the  input  and  the  initial  conditions,  however  it  is  difficult  to  give  analytical 
results  for  the  half-times,  T,  of  the  deprivation  simulations.  One  can,  however,  make  some  predictions  about  the 
general  characteristics  of  these  times.  Expanding  the  initial  weight  vector  in  terms  of  the  eigenvectors  (vj)  of  the 


natural  scene  covariance  matrix,  mo  = 


,  adding  the  assumption  that  natural  scenes  are  dominated 


by  the  first  eigenvector  of  the  covariance  matrix,  vi  with  eigenvalue  Ai ,  and  taking  appropriate  time  limits  (see 
Appendix  A),  we  obtain  the  following  equations  for  the  time  development  of  the  weights 

sr  if  [H  +  -t-  {a‘j  -  op]  \ 

„"■>(.)  =  - Sj  H  vyl(»i +  +  ) -  (3,1) 

(I  Ei  +  (o'  -  op2]  +  1  _  ^ .  [(ap2  + 

^  V  (3.2) 

^  (e2Ait  _j_  Q2aHyf2  ^  ^ 


(e2<r2t  _|.  gg2Ai<)l/2 


Comparing  the  MD  and  RS  solutions  (Equations  3.2  and  3.4)  one  sees  that  the  times  for  the  decay  and 
recovery  of  neuronal  activity  must  be  identical  for  each  regardless  of  noise  levels  and  input  statistics.  Therefore 
the  PCA  model  predicts  correctly  the  time  for  the  neuronal  activity  to  fall  in  these  deprivation  situations,  but 
fails  to  properly  predict  the  time  for  the  recovery  of  activity  in  RS  compared  to  MD. 

Equation  3.3  implies  that  a  neuron  following  Oja’s  rule,  experiencing  binocular  deprivation  following  normal 
rearing,  performs  a  random  walk  about  the  normal  reared  state.  Thus  PCA  is  again  inconsistent  with  the 
experiment  results. 


BCM  Results 

In  order  to  determine  the  dependence  of  the  response  half-times  on  model  and  input  parameters  we  need  to 
perform  simulations  over  a  range  of  those  parameters  and  measure  the  time  T  for  each  of  these.  The  response 
half-times  for  each  deprivation  experiment  depend  on  the  parameters  in  different  ways,  so  it  is  possible  to  find 
a  parameter  regime  which  yields  consistent  time  ratios.  The  parameter  regime  is  initially  chosen  to  give  stable 
simulations,  and  then  explored  more  finely  to  determine  regions  with  consistent  time  ratios.  Stability  is  lost  if 
the  learning  rate  is  too  large,  or  if  the  memory  constant,  r,  is  too  large  causing  BCM  sliding  threshold,  9  to  move 
too  slowly. 
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Parameters  for  BCM  Simulations 

Learning  Rule 

Activation  Rule 

cortical  sigmoid 

Initial  threshold 
Input  mean 

Input  variance 

RF  Diameter 
Retinal  DOG  ratio 

rii  =  r}c{c  -  0)d 

9) 

c  =  cr(m  *  d) 

o(-)  J  cr(-oo)  =  —1 

<7(+oo)  =  50 

9o  =  0.73 
(d)  =  -3.3  •  10-® 
var(d)  =  1.0 

13  pixels 

3:1 

Learning  rate 
Memory  constant 
Noise  Levels 

7/ =  5- 10-',.. .,5  10-“ 
r  =  10,  ...,3510 
uniform  noise= 
[-.25:.25],...,[-2.5,2.5] 

The  two  most  important  parameters  are  the  noise  level  to  the  closed  eye  and  the  memory  constant,  r. 
Figure  4  shows  the  results  of  varying  these  two  parameters.  We  see  that  while  the  noise  level  has  a  dramatic  effect 
on  the  time  course  of  the  neuronal  response,  the  memory  constant  has  suprisingly  little  effect.  This  may  indicate  a 
striking  difference  between  the  natural  scene  environment  and  previous  work  done  with  abstract  inputs(Clothiaux 
et  al.,  1991),  where  the  memory  constant  played  a  more  important  role  in  the  timing. 

We  see  from  Figure  4  that  the  dependence  on  the  noise  level  is  different  for  each  deprivation  simulation. 
This  allows  us  to  possibly  locate  a  range  of  noise  levels  for  which  the  relative  times  are  consistent  with  experiment. 
Figure  5  displays  all  of  the  parameter  points  explored,  and  which  ones  yielded  time  ratios  consistent  with  all  of 
the  experimentally  determined  ratios. 


4  Summary  and  Conclusions 

It  has  been  demonstrated  that  the  PCA  rule  fails  to  account  for  the  time  course  of  the  deprivation  experiments 
in  a  manner  consistent  with  the  experiment.  Most  dramatic  is  the  result  that  binocular  deprivation  to  a  PCA 
neuron  gives  only  a  random  walk  response.  BCM  on  the  other  hand  can  account  for  the  time  course,  within  a 
particular  parameter  regime.  This  parameter  regime  can  be  summarized  by  the  range  of  3  parameters: 

•  memory  constant  r  =  500,  ...,3000 

•  learning  rate  7]  =  4.5  •  lO""®, ...,  6  •  10”® 

•  noise  level  a  =  0.88,...,  1.4  (or  [-1.1:1.!], ...,[-1.45:1.45]) 

Note  that  the  valid  parameter  regime  is  not  defined  by  a  sharp  boundary,  but  that  near  the  edge  the  system  is 
less  robust. 

One  of  the  features  of  this  approach  is  the  direct  calculation  of  the  model  parameters  in  terms  of  ex¬ 
perimental  quantities.  Using  the  range  of  half-time  values  exhibited  across  the  valid  parameter  regime  for,  say, 
monocular  deprivation,  and  attributing  that  range  to  the  known  6-12  hour  range  obtained  from  experiment,  we 
can  find  a  range  for  the  possible  values  of  r  in  minutes.  Doing  this  we  find  that  r  ranges  between  1-15  minutes. 
We  are  investigating  how  this  might  be  affected  by  the  slope  of  the  modification  function,  <j>^  at  threshold  and  the 
form  of  the  cortical  sigmoid.  A  final  determination  of  the  allowed  values  of  r  may  give  us  clues  to  the  cellular 
and  molecular  processes  involved. 
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A  Classical  Rearing  Conditions:  PCA  Analysis 


The  Wyatt  solution  is  the  explicit  time-domain  solution  of  Oja’s  equation  for  a  single  neuron 

m  =  c(d  —  cm) 

This  solution  is  given  in  terms  of  the  initial  weight  vector,  mo,  and  the  covariance  matrix  of  the  input,  C 
by  the  expression: 

=  7 - ^ ^ ^ 

In  this  section  we  use  the  Wyatt  solution  to  determine  the  time  dynamics  of  a  neuron  following  Oja’s 
learning  rule  in  an  environment  modeling  the  classical  visual  cortical  plasticity  experiments. 

Some  notation: 

single  eye  input  vectors:  =  left  eye  inputs,  d’*  =  right  eye  inputs 

single  eye  covariance  matrix:  C  =  (dd^) 

.  ^  \ 


full  input  vector: 


full  covariance  matrix: 


natural  scene  (single  eye)  co- 
variance  matrix: 
eigenvectors / values  of  co- 
variance  matrix: 


(assumption)  noise  (single 
eye)  covariance  matrix: 


C  =  (DD'^)  =  { 

_  /  c"  C'’’ 


)  ((d')^  (do^) 


Cvj==XjVj  (j  =  l,...,n) 

vjvj  =Sij 

Ai  >  A2  >  •  *  •  >  An 


The  rearing  experiments  in  this  new  notation  are  as  follows: 


The  general  procedure  will  be  the  following: 

•  expand  the  initial  weight  vector  mo  in  terms  of  the  eigenvectors  of  the  covariance  matrix  (v^). 

•  plug  into  the  Wyatt  solution  (Equation  A.5)  to  obtain  m(t).  We  will  have  to  use  the  full  covariance  matrix 
C  instead  of  the  single  eye  covariance  matrix  C. 

•  add  approximations  to  simplify  the  expression 

We  present  each  rearing  condition  currently. 
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Normal  Rearing  (NR) 

•  expand  the  initial  weight  vector  mo  in  terms  of  the  eigenvectors  of  the  covariance  matrix  (vj). 


mo  = 


•  plug  into  the  Wyatt  solution  (Equation  A. 5)  to  obtain  m{t) 


We  need  to  do  this  part  in  steps,  calculating  Cmo  first,  then  calculating  each  term  in  Equation  A.5. 


Cmo  = 


C^mo  = 


/  C  C  /  a'  vj  \  /  Xj{a‘i  +  apVj  N 

C  C  ;  ^  V  ;  Y  V  +apv,-  J 

^  Aj {aj  +  Oj)  (  ^ 

(c  c)EM»5+a;)(:p 

^2A?(a;+a;) 


C‘mo  = 


e*'*mo 


ri+(c<)+<^+ 


2! 


■) 


mo 


=  1  /  Vj  [(a*.  +  +  (a'.  -  op]  A 

2  V  Vj-  [(o'-  +  ope^-'*  +  (oJ  -  op]  ) 


+  • 


^3 


llmoll^  =  mj’mo  =  ^  [(op^  +  {aTjf 


0’j+  =  (®j  +  “p 
flj-  =  (Oj  -  op 

||e«molf  =  ^  +  a|_  +  2aj.aj+e^^^^  +  -  2a,_a,+e2"i*] 

j 

=  I  E[(“i 
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which  brings  us  to  our  solution  for  normal  rearing 

^  I  (  [(4  +  -  ap]  ^ 

2  vj  [(4  +  ope2^>‘  +  (aj  -  4)]  j 


(I  Ei  [(«; + + (<•!  -  »p"]  + 1  -  E;  [(op"  +  (op"]) 

•  add  approximations  to  make  the  equations  simpler 


1/2 


(A.6) 


The  t  oo  limiting  case,  needed  for  the  calculations  in  the  next  few  sections,  is  straightforward  to 
calculate.  If  the  largest  eigenvalue  is  non-degenerate,  then  m  will  become 


-4  oo) 


=/!(::) 


Monocular  Deprivation  (MD) 

•  expand  the  initial  weight  vector  mo  in  terras  of  the  eigenvectors  of  the  covariance  matrix  (vj). 

Since  we  are  starting  from  the  oo)  state,  the  initial  weight  vector  for  monocular  deprivation  is 

already  in  terms  of  the  eigenvectors  of  the  covariance  matrix. 


mo 


•  plug  into  the  Wyatt  solution  (Equation  A.5)  to  obtain  m(t). 

=  (o  “0\/|(v,  )  =  \/l(iQ) 


e‘^*mo 


/T  ( 

V  2  V  e''"' 


Vl 

Vl 


IlmolP  =  1 


|e^‘mo!l' 


2 


which  yields 


(  e'^*‘vi  \ 

V  ) 


(e2Ait  ^g2<r2t)l/2 

add  approximations  to  make  the  equations  simpler 


(A.7) 


The  assumption  we  are  going  to  make  is  that  Ai  >  cr^.  This  is  reasonable,  because  the  noise  to  the  closed  eye 
should  be  smaller  than  the  eigenvalue  from  the  natural  scene  covariance.  With  this  assumption,  the  f  — >  oo 
limiting  case  becomes 

m“(l  ^  oo)  =  (  ;■  ) 


Binocular  Deprivation  (BD) 

•  expand  the  initial  weight  vector  mo  in  terms  of  the  eigenvectors  of  the  covariance  matrix  (v^  ). 
As  in  MD,  the  initial  weight  vector  is 
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plug  into  the  Wyatt  solution  (Equation  A. 5)  to  obtain  m{t). 


which  yields 


e‘^*mo 


IlmolP 


1  /  e^'‘vi 


2  \  e*"  *vi 


=  1 


=  * 


=yi(v;) 


(A.8) 


Equation  3.3  implies  that  a  neuron  following  Oja’s  rule,  experiencing  binocular  deprivation  following  normal 
rearing,  performs  a  random  walk  about  the  normal  reared  state. 


Reverse  Suture  (RS) 

•  expand  the  initial  weight  vector  mo  in  terms  of  the  eigenvectors  of  the  covariance  matrix  (vj). 

We  run  into  an  immediate  problem  if  we  try  to  use  -¥  oo)  as  mo:  the  newly  opened  eye  never 

recovers.  To  alleviate  this,  we  assume  that  the  monocular  deprivation  experiment  did  not  achieve  t  =  oo,  but 
just  some  large  number  T.  In  that  case  the  initial  weight  vector  for  RS  is 

=  (  ev.  ) 

where  c  ~  -C  1 

•  plug  into  the  Wyatt  solution  (Equation  A.5)  to  obtain  m(^). 


which  yields 


-  (o  c)(;‘)=(C‘.) 

) 

IlmolP  =  1 


in^S(t) 


+  ee2Aif)i/2 


(A.9) 
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All  ratios 


Figure  5:  BCM  Results:  The  valid  parameter  regime.  Parameter  points  explored  are  denoted  with  o.  Parameter 
points  satisfying  the  experimentally  determined  time  ratios  are  denoted  with  Note  that  the  high  density  of 
points  explored  in  one  parameter  region  is  a  result  of  resampling  around  points  where  we  found  valid  time  ratios. 


